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ABSTRACT 


This  report  proposes  a  resynchronization  technique  for  a 

Fano  type  sequential  decoder.  The  method  does  not  use  repeat- 

request  feedback  or  periodic  restarting  and  is  only  employed 

when  a  buffer  overflow  indicates  a  very  noisy  channel  condition. 

A  program  was  written  to  execute  this  algorithm  for  a 

simulated  Gaussian  channel  for  several  values  of  E/N  .  The 

o 

results  imply  that  this  is  a  feasible  resynchronization  scheme. 
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A  RESYNCHRONIZATION  TECHNIQUE  FOR  A  SEQUENTIAL  DECODER 


Sequential  decoding  has  been  shown  to  be  theoretically  and  practically  realizable 
to  achieve  reliable  communications  over  a  number  of  randomly  disturbed  channels. 
However,  in  implementing  sequential  decoding  the  equipment  model  must  compromise 
some  of  the  characteristics  of  the  theoretical  model;  essentially  the  infinite  buffer 
storage  and  infinite  encoding  constraint.  Truncation  of  the  encoding  constraint  in¬ 
creases  the  probability  of  undetected  error.  The  finite  buffer  permits  overflow  situa-. 
tions  which  causes  further  decoding  to  proceed  in  a  haphazard  fashion  until  resynchro¬ 
nization  occurs.  This  synchronization  is  a  restarting  method  for  initializing  the  decoder 
to  a  set  of  known  conditions  at  the  encoder.  We  are  here  concerned  with  a  solution  to 
the  restarting  problem  after  a  buffer  overflow  has  occurred. 


At  this  point  we  will  describe  the  decoding  algorithm  in  some  detail.  This  should 
make  the  later  discussions  of  overflow  clear  and  give  the  reader  an  appreciation  of  the 
problem  posed.  The  Fano  decoding  algorithm  is  employed.  We  assume  a  memoryless 
channel  with  an  input  alphabet  I  of  s  symbols  and  an  output  R  of  s  random  variables, 
each  variable  associated  with  one  of  the  input  letters.  Thus  the  channel  is  defined  when 
the  resulting  probability  distributions  of  the  received  random  variables  are  known  for 
the  input  alphabet  I.  With  these  random  variables  we  can  compute  the  s  values  of  the 
conditional  probabilities  p(V/x)  where  V  is  a  vector  or  list  of  the  s  outputs  at  the 
receiver  and  x  takes  on  the  values  of  the  s  symbols  in  I.  At  the  receiver  a  list  V  is 
created  at  discrete  time  intervals  At.  The  list  must  be  kept  for  some  time  to  provide 
for  possible  changes  in  the  decoder  decisions  about  the  transmitted  data. 


Figure  1  is  a  schematic  of  the  Fano  decoder.  Each  radius  in  the  inner  circle  is  a 
memory  unit  containing  a  vector  resulting  from  received  data  at  t  +  jAt.  Re¬ 

call  again  that  each  entry  in  this  vector  is  associated  with  one  of  the  symbols  of  I. 

This,  data  is  never  changed  in  executing  the  decoding  algorithm.  It  is  used  to  compute 
a  cumulative  measure  associated  with  each  decision  about  the  transmitted  information. 
This  accumulated  measure  in  conjunction  with  a  set  of  thresholds  determines  when 
searches  are  made.  These  searches  are  ways  of  changing  our  past  decisions  so  as  to 
obtain  an  optimum  measure  for  the  entire  sequence  of  decisions. 
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Fig.  1 
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The  memory  as  pictured  in  Fig.  1  is  a  circular  buffer.  Each  memory  cell  is 
filled  in  succession  and  if  the  capacity  is  n  memory  cells  then  cell  1  is  filled  after 
cell  n.  The  radial  segments  in  the  annular  region,  labeled  H.  are  the  current  hypo¬ 
theses  of  the  transmitted  data.  These  segments  could  be  considered  to  be  part  of  the 
same  memory  cell  containing  V..  In  this  sense  Vj  is  the  address  of  the  memory  unit 
no  matter  when  the  data  was  received.  At  regular  intervals  of  At  as  information  is 
received  and  placed  into  memory  location  V.  the  data  in  IT  is  passed  on  to  the  user. 

The  outer  arc,  C,  forms  a  window  that  covers  C  storage  elements.  It  is  a 
register  that  contains  the  information  bits  that  are  the  IT  hypotheses.  In  combination 
with  other  registers  of  the  same  length,  called  codes,  further  hypotheses  are  generated, 
each  with  a  cumulative  measure  to  that  point.  On  the  basis  of  this  measure  and  with 
respect  to  the  thresholds  in  effect,  C,  moves  forward  or  backward.  If  the  threshold 
is  exceeded  C  shifts  forward,  wormlike,  dropping  its  oldest  information  bits  and  making 
a  new  hypothesis  entry  at  its  forward  end.  If  the  threshold  is  not  exceeded  C  moves 
back  picking  up  a  hypothesis  older  than  its  current  oldest  entry  and  tries  an  alternate 
newest  hypothesis.  Thus  although  the  decoder  receives  information  at  equal  intervals 
of  time  it  makes  decisions  on  a  decoding  at  variable  time  intervals. 


Assume  that  when  the  memory  cells  are  filled  with  new  vectors  that  the  IT, 
although  given  to  the  sink,  are  left  intact.  Then  in  a  search  condition  the  decoder  could 
find  itself  in  a  situation  in  which  the  list  in  cell  j  is  unused  and  not  directly  related  to 
the  hypothesis  IT.  Thus  the  measure  for  an  alternate  hypothesis  at  this  point  is  un¬ 
available  since  p(V./x)  cannot  be  determined.  The  V.  is  associated  with  data  trans¬ 
mitted  nAt  later  than  the  data  in  which  we  are  interested.  This  situation  is  termed 
a  buffer  overflow.  Successful  decoding  can  no  longer  take  place  until  the  encoder  at 
the  transmitter  end  and  the  decoder  at  the  receiver  end  can  start  with  an  identical  set 
of  initial  conditions. 


Several  methods  for  solving  the  problem  have  been  proposed.  One  solution  is  to 
have  periodic  ending  and  restarting  procedures.  In  effect  this  is  sequential  decoding  by 
blocks.  Overflow  can  still  occur  but  the  data  loss  in  that  event  is  only  a  block.  There 
is  in  addition  some  loss  in  the  effective  communication  rate  due  to  informationless 
beginnings  and  tails.  Another  solution  employs  a  two  way  feedback  system  with  re¬ 
transmission  in  the  event  of  overflow  to  prevent  the  loss  of  data.  This  method  loses  no 
information  but  becomes  costly  and  complex. 
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The  restarting  procedure  suggested  here  comes  into  play  only  when  a  buffer 

overflow  occurs.  Our  aim  is  to  find  a  set  of  conditions  matching  those  at  the  encoder. 

Now  the  channel  is  assumed  to  be  noisy  such  that  merely  accepting  the  most  likely 

transmitted  symbol  enough  times  to  obtain  a  sequence  C  would  probably  result  in  a 

sequence  that  differed  from  the  transmitted  one.  We  will  therefore  look  for  a  sequence 

that  we  believe  differs  from  the  correct  (transmitted)  data  in  some  small  number  of 

_  .  * 

known  positions.  This  is  accomplished  by  comparing  the  probability  p^  =  p(V^.  H^.) 

with  some  arbitrary  number  T  .  H,  is  that  symbol  of  the  alphabet  I  for  which 

c  K  _ 

Pk  =  p(Vk/x)  is  a  maximum  over  x  in  I.  If  2:  T  ,  is  noted  as  True,  T,  else  it  is 
marked  Questionable  or  Q.  If  W  ,  the  number  of  Q  entries  is  less  than  some  arbitrary 
number  N£  such  a  sequence  is  called  a  feasible  C  sequence. 

The  next  step  is  to  find  a  feasible  sequence  of  most  likely  symbols  immediately 

following  C  whose  length  is  F.  F  has  associated  with  it  parameters  Tp  and  Np  which 

serve  for  F  as  T  ,  and  N  serve  for  C. 
c  c 

Having  found  C  and  F  which  can  be  defined  C  a  F  =  R,p,  a  resynchronization 
trial  vector,  we  will  test  our  hypotheses  that  C  is  the  information  sequence  that  was 
transmitted.  The  test  is  simple.  An  attempt  is  made  to  decode  for  F  steps  with  the 
condition  that  the  maximum  decoding  measure  is  achieved.  Such  a  result  is  interpreted 
as  having  resynchronized  by  having  matched  the  encoder  conditions.  If  the  F  positions 
cannot  be  so  decoded  those  positions  in  C,  labeled  Q,  take  on  a  new  permutation.  A 
next  attempt  is  then  made  to  go  forward  over  F.  Each  failure  causes  us  to  take  a  new 
arrangement  of  C  until  all  possible  configurations  obtainable  by  varying  the  Wc  ques¬ 
tionable  positions  are  exhausted.  Our  next  step  is  to  change  F  in  its  Q  positions  and 
start  again  with  C  having  its  most  probable  first  sequence  as  a  new  starter.  Lacking 
success  after  all  F  and  C  sequences  have  been  tried  the  windows  C  and  F  are  moved 
ahead  some  given  amount  and  an  attempt  is  made  to  find  a  new  R,p . 


Figure  2  is  a  logical  flow  chart  of  the  proposed  resynchronization  technique. 

Figure  3  is  the  same  as  Fig.  1  except  that  the  segment  formerly  marked  H.  to  denote 

A  A  J 

sequential  decoding  hypotheses  are  marked  .  Now  the  Hj  are  the  most  likely  trans¬ 
mitted  data  on  the  basis  of  alone.  F,  the  shorter  window  has  been  described  before. 


A  computer  program  was  written  to  execute  this  algorithm.  An  M-ary  modu¬ 
lation  scheme  was  assumed  over  a  gaussian  channel  with  matched  filter  detection. 
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The  information  rate  was  1/ 3  bit  per  waveform  and  there  was  one  waveform  per  de¬ 
coding  step  or  branch.  In  order  to  simplify  the  program  Tc  and  Tp  were  made  equal 
and  Np  was  set  to  zero.  In  this  way  only  the  sequence  C  was  varied.  For  the  current 
problem  the  step  ahead  corresponded  to  skipping  over  R^. 

A  number  of  computer  runs  were  made  for  several  lengths  of  F  and  varying  values 
of  T£  and  N£.  Er/No,  the  signal-to-noise  power  per  transmitted  waveform  was  also 
varied.  C  was  fixed  at  36  bits.  The  most  interesting  results  are  presented  in  Tables  1, 

2  and  3.  All  the  column  headings  have  previously  been  defined  except  'Memory 
References'  and  'Resyn.  False' .  'Memory  References'  is  the  total  number  of  memory 
references  that  would  have  been  made  before  a  successful  resynchronization  on  the 
assumption  that  all  computation  to  move  C  forward  or  backward  one  position  is  done  in 
one  memory  read-write  cycle.  This  quantity  does  not  include  the  memory  references 
to  find  C  0  F  =  R,p.  The  entry  'Resyn.  False’  means  that  the  C  hypothesis  test  indi¬ 
cated  a  successful  resynchronization  when  in  fact  this  was  not  so.  All  the  runs  con¬ 
sisted  of  1000  transmitted  symbols.  The  run  number  is  merely  an  identifier  for  such 
a  run.  Each  trial  is  a  successful  search  for  an  R^. 

Table  3  presents  the  results  of  holding  all  parameters  constant  and  using  different 
random  noise  sequences,  i.  e.  different  samples  of  the  same  channel.  The  constant 
values  of  F,  Nc  and  T  were  considered  a  good  set.  Although  there  are  only  four  such 
runs  the  lack  of  wide  variation  in  the  results  is  very  promising. 

Better  results  can  be  expected  by  altering  the  procedure  in  a  number  of  ways. 

The  parameters  T£,  Tp,  N£  and  F  can  be  matched  to  the  channel  and  code  length  C. 

Also  there  are  a  variety  of  ways  to  select  successive  trial  sequences  depending  on  like¬ 
lihood  and  position  in  C.  The  fidelity  criteria  which  is  now  either  True  or  Questionable 
could  be  continuously  valued  to  give  a  better  selection  of  trial  sequences.  The  hypothesis 
sequence  can  also  be  tested  in  a  manner  that  permits  some  searching.  All  these  modi¬ 
fications  bring  complications  but  should  improve  the-  performance  of  the  resynchronizer. 

Admittedly,  the  number  of  experiments  is  small.  Nevertheless  the  method 
appears  to  be  a  simple  workable  solution  to  the  resynchronization  problem  in  sequential 
decoding. 
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TABLE  1 


F  /N  =3.4,  R  =1.4,  Transmission  Rate  =  .71  x  Ro _ 

r  o  comp  comp 


Run 

W 

c 

F 

T 

c 

Total 

Trials 

Resyn. 

Success 

Resyn. 

False 

Fail¬ 

ures 

Memory  References 

15 

5 

5 

.75 

12 

1 

0 

11 

9418 

28 

7 

5 

.70 

22 

2 

1 

19 

(184)t 

50 

5692 

16 

7 

5 

.75 

19 

4 

1 

14 

580 

(1142) 

549 

1328 

2157 

29 

7 

5 

.80 

12 

3 

1 

8 

1423 

9731 

(304) 

4966 

17 

9 

5 

.75 

20 

2 

4 

14 

(292) 

60 

650 

(2926) 

(4655) 

(591) 

18 

5 

6 

.75 

11 

1 

0 

10 

9458 

19 

7 

6 

.75 

18 

3 

0 

15 

547 

1748 

1503 

5 

10 

6 

.75 

18 

2 

0 

16 

540 

2270 

7 

10 

6 

.65 

23 

1 

0 

22 

3444 

8 

10 

6 

.85 

12 

0 

0 

12 

9 

15 

6 

.65 

23 

1 

0 

22 

3444 

10* 

15 

6 

.75 

14 

2 

0 

12 

540 

2270 

14 

7 

6 

.85 

5 

1 

0 

4 

13175 

21 

5 

7 

.75 

11 

1 

0 

10 

9262 

22 

7 

7 

.75 

14 

2 

0 

12 

3644 

11578 

23 

9 

7 

.75 

17 

1 

0 

16 

4595 

*  744  bits  only 

t  (  )  denotes  a  false  resynchronization 
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TABLE  2 


E  /N  =  3.  0,  R  =1.  2,  Transmission  Rate  =  .  83  x  R 
r  o  comp  comp 


Run 

W 

c 

F 

T 

c 

Total 

Trials 

Resyn. 

Success 

Resyn. 

False 

Fail¬ 

ures 

Memory  References 

30 

5 

5 

.75 

8 

2 

1 

5 

(2228  )t 

3744 

4115 

31 

7 

5 

.75 

13 

2 

1 

10 

1574 

9784 

(3129) 

32 

9 

5 

.75 

17 

2 

2 

13 

850 

(490) 

(3512) 

2287 

33 

5 

6 

.75 

7 

1 

0 

6 

5929 

34 

7 

6 

.75 

13 

1 

0 

12 

11265 

35 

9 

6 

.75 

17 

1 

2 

14 

818 

(7838) 

(538) 

6 

10 

6 

.75 

19 

1 

4 

14 

36 

5 

7 

.75 

6 

0 

0 

6 

818 

(4823) 

(1197) 

(784) 

(2685) 

37 

7 

7 

.75 

11 

1 

0 

10 

17238 

38 

9 

7 

.75 

13 

1 

1 

11 

(10754) 

11861 

t  (  )  denotes  a  false  ^synchronization 
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TABLE  3 


E  /N  =  3.  4,  R  =  1.4,  Transmission  Rate  =  .71  x  R _ 

r  o  comp  comp 

Four  different  random  sequences 


Run 

W 

c 

F 

T 

c 

Total 

Trials 

Resyn. 

Success 

Resyn. 

False 

Fail¬ 

ures 

Memory  References 

16 

7 

5 

.75 

19 

4 

1 

14 

580 

(1142)t 

549 

1328 

2157 

25 

7 

5 

.75 

17 

5 

1 

11 

51 

(1994) 

416 

1308 

83 

6281 

26 

7 

5 

.75 

16 

2 

1 

13 

423 

(6104) 

4485 

27 

7 

5 

.75 

17 

5 

2 

10 

2563 

(2285) 

2579 

(1886) 

160 

815 

853 

t  (  )  denotes  a  false  resynchronization 
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